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Abstract. This paper contains results on stable bundles of rank 2 with space of 
sections of dimension 4 on a smooth irreducible projective algebraic curve C . There is 
a known lower bound on the degree for the existence of such bundles; the main result 
of the paper is a geometric criterion for this bound to be attained. For a general 
curve C of genus 10, we show that the bound cannot be attained, but that there 
exist Petri curves of this genus for which the bound is sharp. We interpret the main 
results for various curves and in terms of Clifford indices and coherent systems. 



1. Introduction 

This paper began life some years ago with a proof that, on a general curve of genus 
10, there does not exist a stable bundle of rank 2 and degree 12 with 4 independent 
sections, but that such bundles do exist on certain Petri curves of genus 10. The 
motivation for this came partly from a paper of C. Voisin [22] concerning bundles 
of rank 2 with canonical determinant and partly from results involving the Clifford 
index contained in [H]. In fact, the classical Clifford's theorem for line bundles has 
been extended to semistable bundles of higher rank by G. Xiao |2H p. 477] (see also 
[51 Theorem 2.1]) as follows: if is a semistable vector bundle of rank n and slope 
/X = ^ on a smooth projective curve C of genus g such that < < 25f — 2, then 
hP{E) < f + n. This result was improved by R. Re |19j| and further refined by the 
second author [14] to a version which takes into account the Clifford index 71 of C. 
In [HI, it is conjectured that, for (? > 4 and E semistable, h^{E) < + n for 

71 + 2 < /i < 2(7 — 4 — 7i. Note that, for a general curve of genus 10, the Clifford index 
is 4, so, when n = 2, the conjecture becomes 

h^{E) < ^ - 2 for 6 < < 12. 

In particular bundles of degree 12 with /i° = 4 represent a "corner point" for these 
inequalities. 
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The result mentioned above was never published and, as far as we are aware, has 
not been published since except in a brief form in the survey article However, 
there have been several developments that add to the interest of the result and also 
place it in a more general context. The first of these is the broadening of higher rank 
Brill-Noether theory into the study of coherent systems on curves (in fact the form 
of the result in [16] is in this context). The second is the introduction of higher rank 
Clifford indices (see [10]) as follows. Let C be a smooth projective curve of genus 
g > 4:. For any vector bundle E of rank n and degree d on C, consider 

1 h^(E) 
ME) ■=-(d- 2(h%E) - n)) = fi(E) - + 2. 

n n 

For any positive integer n we then define the following invariants of C: 



In ■■= min <j 7(E) 



E semistable of rank n 
h^{E) > n + 1, fi{E) <g-l 



and 

, • f / r-i\ E semistable of rank n 
7.:=min|7(i?) h^^E) > 2n, ^^iE) < g - 1 

Note that 71 = 7^ is the usual Clifford index of the curve C. 

These definitions have led to a modified form of the conjecture of [H] as 7^ = 71. The 
third reason for added interest in the problems we discuss here is that, very recently, 
a counter-example to the conjecture for n = 3 has been noted [15]. For n = 2, the 
conjecture is still open and we do not construct any counter-examples here, but our 
results do suggest where one might look for them. 

Finally, new estimates for the dimensions of Brill-Noether loci with fixed determinant 
have been obtained, also very recently, by B. Osserman [17J. 

In order to state our results, we need some definitions. Let C be a smooth irreducible 
projective algebraic curve of genus g > 2 defined over the complex numbers, and let 
M{n,d) (resp. M{n,d)) denote the moduli space of stable vector bundles (resp. S- 
equivalence classes of semistable vector bundles) of rank n and degree d over C. The 
Brill-Noether locus B{n, d, k) is the subvariety of M(n, d) defined by 

Bin, d, k) = {Ee M{n, d) \ h\E) > k}. 

Corresponding subvarieties B{n,d,k) of M{n,d) can be defined similarly; note that 
B{n, d, k) = B{n, d, k) when gcd(n, d) = 1. The most fundamental question concerning 
these loci is to determine when they are non-empty (see [8] for a survey of results on 
this and other questions in the Brill-Noether theory of vector bundles). The purpose 
of this paper is to study this question in the first case for which the answer is not 
completely known, namely n = 2, k = 4. 

For general curves, M. Teixidor i Bigas has obtained non-emptiness results using 
degeneration methods [SUj and L. Brambila-Paz has obtained both emptiness and non- 
emptiness results by other methods [1]. However we shall work in a wider context. For 
this, we need a definition from [10]; the gonality sequence {dr} of C is defined by 

dr := min{degL | L a line bundle on C with h^{L) > r + 1}. 
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We say that dj. computes 71 if dr 
theory, we have always 



< g — 1 and 71 = (i^ — 2r. By classical Brill- Noether 



(1) 



dr < g + r 



r + 1 



We need also the concept of a Petri curve; the precise definition is not important, 
but we do require the facts that a general curve is Petri, that there exist Petri curves 
lying on K3 surfaces (see [TT]) and that, on a Petri curve, the inequalities of ([T]) are all 
equalities. Although the definition of Clifford index requires g > 4, the formulae for 
the gonalities are valid for all g. 

In section |51 we obtain results on semistable and stable bundles of rank 2 with 
> 4, especially those of degree < 2di (note that such a bundle always has degree 
> min{2c?i, ^4} (see [101 Theorem 5.2] and Proposition 12.41 below)). In particular we 
determine the emptiness or non-emptiness of B{2,d,4) and B{2,d,4) in many cases 
(Proposition 12.11 and Remark 12. 7p . We also discuss these results for various different 
curves (Examples l2.8f[2rT0|) . In section [3l we suppose ^4 < 2di and concentrate on 
stable bundles of this type which have the minimum possible degree d^. This leads to 
our first main theorem: 

Theorem 13.21 Suppose d^ < 2di . Then 

(i) if B{2,d4,A) 7^ 0, there exists a line bundle M G 5(1,^4,5) such that (pAiiC) 
is contained in a quadric; 

(ii) if d4^ < 2di and there exists M G 5(1,^4,5) such that 4>m{C) is contained in a 
quadric, then 5(2,^4,4) 7^ 0. 

(Here, for any generated line bundle M, (pM denotes the morphism C — )■ P(i7°(M)*) 
defined by evaluation of sections of M.) We relate this result to possible counter- 
examples to the conjecture 72 = 71 (Remark 13. 5p and, for Petri curves, to the possible 
existence of non-empty Brill-Noether loci for which the expected dimension 

/3(2, d, 4) := 4^ - 3 - 4(4 - + 2^ - 2) 

is negative (Remark 13.61) . We obtain also an upper bound for dim 5(2, ^4, 4) for a 
general curve of genus g > 10 (Proposition 13.71) . 

In section HI we prove the main result of the original version of this paper, namely 

Theorem 14.11 (i) Let C be a general curve of genus 10. Then 5(2, ci, 4) ^ ^ if and 
only if d> 13. 

(ii) There exist Petri curves of genus 10 for which B(2, 12, 4) 7^ 0. 

In section O we discuss curves of odd genus and obtain an interesting example 
for g = 5 (Proposition 15.11) . Finally, in sectional we show how our results can be 
interpreted in terms of coherent systems. 

Throughout the paper, C is a smooth irreducible projective curve of genus g > 2 
defined over an algebraically closed field of characteristic 0. The canonical bundle on 
C is denoted by K. For any vector bundle E on C, we write for the degree of E. 
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2. Bundles of rank 2 with 4 sections 

Proposition 2.1. Let C be a curve of genus g >2. Then 

(i) 5(2,2^1,4)^0; 

(ii) B{2,d,A) 7^ if d > 2di + 3; moreover, if there exist two non-isomorphic line 
bundles Li, L2 of degree di withh^{L.i) = 2, then B{2,d,4:) ^ ^ for d > 2di + l; 

(ill) ifd<2di, then B{2,d,A) = B{2,dA); 

(iv) ife< 2di and B{2, e, 4) ^ 0, then B{2, d, 4) ^ /or d > e. 

Proof, (i) By definition, there exist line bundles on C of degree di with = 2. Let 
Li, L2 be two such line bundles. Then Li ©L2 is semistable of degree 2di with h^ = 4. 

(ii) Consider extensions 

(2) ^ Li © L2 ^ ^ ^ r ^ 0, 

where Li, L2 are non-isomorphic line bundles of the same degree with h^{Li) = 2 and 
r is a torsion sheaf of length t > 0. Such extensions are classified by pairs (61,62), 
where 6j G Ext"^(r, Lj). When t = 1, it is easy to see that E is a stable vector bundle 
provided 61 and 62 are both non-zero. For any t > 0, it is in fact true that ii^ is a 
stable vector bundle for the general extension (|2]) [13^ Theoreme A. 5]. This completes 
the proof when Li, L2 have degree di. When there exists only one line bundle L of 
degree di with h^{L) = 2, we take Li = L{p), L2 = L{q) in (|2]), where p, q are distinct 
points of C. 

(iii) Suppose that d < 2di and that E is semistable of degree d. If E is strictly 
semistable, then d is even and there exists a line subbundle L of of degree |. Now 
f < rfi, so /i°(L) < 2 and h°{E/L) < 2. This contradicts the fact that h^{E) > 4, so 
E cannot be strictly semistable. 

(iv) It is sufficient to prove that 5(2,6 + 1,4) 7^ 0, since we can then obtain the 
result by tensoring with effective line bundles. For this, let E G B{2, e, 4) and consider 
extensions 

(3) O^E^F-^T^O, 

where F is a vector bundle and r has length 1. Every line subbundle L of E has 
(ii, < I < di, so h^{L) < 2. Hence every quotient line bundle L' of E has h^{L') > 3. 
It follows that d^i > ^2, so rf^ < 6 — ^2- Thus every line subbundle of F has degree 
<e-d2 + l<^ = /i(F) since 6 < 2di < 2^2 - 2. So F is stable. □ 

Remark 2.2. For a Petri curve of genus g > 3, there exist non-isomorphic Li, L2 of 
degree di with h^{Li) = 2 and Proposition I2.1( ii) states that 5(2, (i, 4) is non-empty 
foTd>g + 3 when g is even and for d > g + 4 when g is odd. This was previously 
proved by Teixidor for a general curve using degeneration methods [20]. This implies 
the result for odd d for any curve on which di takes its generic value g + 1 — [|] . On 
the other hand, for a hyperelliptic curve (and in particular any curve of genus 2), there 
is only one line bundle L of degree di = 2 with = 2. The situation for = 2 is 
described in the following proposition. 

Proposition 2.3. Let C be a curve of genus 2. Then 
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• B{2, (i, 4) 7^ ^/ and only if d = A or d>6; 

• B{2,d,4:) ^ if and only ifd>6. 

Proof Suppose first that is a semistable bundle of rank 2 and degree d. If < 3, 
then the Clifford theorem of |23] gives h^{E) < 3. For d = 5, we have h^{E) = 3 by 
the Riemann-Roch theorem. On the other hand, if = 4 or c? = 6, there certainly 
exist semistable bundles E with h^{E) = 4, namely K (B K and Li © L2, where Li, L2 
are any line bundles of degree 3. By Proposition 12. l( ii) . 5(2, rf, 4) 7^ for > 7. Since 
i^'©i^' is the only semistable bundle of degree 4 with = A (see [I9]), it remains only 
to show that there exists a stable bundle E of degree 6 with h^{E) > 4. For this we 
consider extensions 

(4) ^ L ^ E ^ M ^ 0, 

where degL = 2 and degM = 4. Suppose that L ^ K; then h^{L) = 1 and h^{L) = 0. 
On the other hand, h^{M) = 3, so it follows from the cohomology sequence of (jl]) that 
h°{E) = 4. Moreover, it is a standard fact (see, for example, |9j) that, for the general 
extension E is stable. □ 

We now return to the case of an arbitrary curve C of genus g > 2. 

Proposition 2.4. Suppose that E G -8(2, c?, 4) with d < 2di. Let E' be the image of 
the evaluation morphism H^{E) ® O ^ E . Then 

(i) h'^[L) < 1 for every line suhbundle L of E; 

(ii) h\deiE') > 5; 

(iii) d> di- 

Proof, (i) Since E is stable of degree d < 2di, every line subbundle L of E has degree 
di < di and so h^{L) < 1. 

(ii) [This follows directly from (i) and [181 Lemma 3.9]; for the convenience of the 
reader and for future reference, we include a proof.] It follows from (i) that E' is of 
rank 2 and h^{E'*) = (otherwise O would be a direct summand of E' and the other 
factor would be a line bundle L with h^{L) > 3. If E' = E, then E' is stable by 
hypothesis. If E' ^ E, any proper quotient of E' is a non-trivial generated line bundle 
and therefore has degree > di > fi{E'). So again E' is stable. 

Now consider the exact sequence 

(5) O^DviE'y ^V(^O^E' ^0, 

where is a 4-dimensional subspace of H^{E') which generates E'. Applying /\^, we 
obtain the two sequences 

2 

(6) E ^ /\V ®0 ^detE' ^0 
and 

2 

(7) 0-> /\Dv{E'y ^ F ^ DviE'Y ^E' -^0. 

Now, from ([5]), Dv{E') has rank 2, is generated and satisfies h^{Dv{E')) > 4 and 
hP{Dv{E'y) = 0. It follows that any proper quotient of Dy{E') is a non-trivial 
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generated line bundle and therefore has degree > di > jJi{Dy{E')). So Dy{E') is 
at least semistable. Since ^{Dy{E')) = fJ,{E') and E' is stable, this implies that 
h^{Dv{E'y ®E') < 1. Hence, by ([7D, h^{F) < 1 and, by (P, /i°(detE') > 5. 

(iii) Since det E' is a subsheaf of det E, (iii) follows from (ii) and the definition of 
di. □ 

Remark 2.5. Under the same hypotheses, suppose that h^{F) > 0, where F is defined 
by dSD. Then h^{Dv{E'y ® E') > by ©. From the proof of Proposition [23Kii), we 
see that E' is stable and Dy{E') is semistable, and these two bundles have the same 
slope. So Dv{E') = E' and h\F) = 1. 

We have the following corollary, which is also an immediate consequence of flU\ 
Theorem 5.2]. 

Corollary 2.6. Let E be a semistable bundle of rank 2 with h^{E) = 4. Then '~f{E) > 
min{7i,f -2}. 

Proof. From the definition of 7(-E'), we see that it is sufficient to show that ds > 
min{2(ii, (^4}. This follows at once from Propositions I2.4( iii) and I2.1( iii). □ 

Remark 2.7. Propositions 12.11 and 12.41 lead to the following trichotomy: 

(a) > 2di. If also there exist two non-isomorphic line bundles of degree di with 
/i° = 2, then B{2, rf, 4) ^ if and only if d > 2di and 5(2, 4) ^ if and only 
ii d > 2di + 1. If there is only one line bundle of degree di with = 2, the 
same holds except that B{2, 2di + 1, 4) and B{2, 2di + 2, 4) could possibly be 
empty (see Proposition 12.31 for a case in which B{2,2di + 1,4) = 0). 

(b) (^4 = 2di. The same holds as in case (a) except that it is now possible that 
5(2,2(^1,4) 7^ 0; when this happens, 5(2, c/, 4) 7^ if and only ii d > 2di (see 
Proposition I2.1( iv) ) . 

(c) di < 2di. Let d^am be the minimum value of d for which 5(2, d, 4) 7^ 0. Then, by 
Propositions O and [23Kiii), d^ < d^ain < 2rfi. If c/min < 2c?i, then 5(2, rf, 4) ^ 
if and only if > dmin- If dmin = 2(ii, the situation is the same as in case (b). 

Example 2.8. If C is a Petri curve of genus g, we have dr = g + r — [;:^] . It follows 
that, if g is even, then d^ > 2di for g < S. For g = 4, 6, 8, case (a) applies and 
5(2, ci, 4) 7^ if and only ii d > 2di + 1. If fi- = 10, 12, 14, then case (b) applies and it 
may happen that 5(2, 2di, 4) 7^ 0. The case g = 10 will be discussed fully in section HI 

Example 2.9. If C is a smooth plane curve of degree 5 > 5, then di=6 — 1 and 
di = 26 — 1, so we are in case (a). Moreover there exist infinitely many line bundles of 
degree di with /i° = 2, so 5(2, rf, 4) ^ if and only ii d > 26 - 2 and 5(2, c/, 4) ^ if 
and only ii d > 26 — 1. 

Example 2.10. If C is a curve of Clifford dimension > 4 (i.e. none of di, d2, d^ 
computes 71), then we are in case (c). In fact, dr computes 71 for some r > 4. By (TJ 
Corollary 3.5], > 4r — 3 > 3r. So 

4 < (ir - r + 4 < 24 - 4r + 4 = 271 + 4 < 2di. 

If C has Clifford dimension 3, then C is an intersection of 2 cubics in (see [12]) and 
has genus 10 with 71 = 3. It follows that di = Q and d^ = 12, so we are in case (b). 
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3. Bundles of degree 

In this section, we consider the case where < 2di and dE = d^^ and state and 
prove our first main theorem. 

Lemma 3.1. Suppose d^ < 2di and E G 5(2,^4,4), then 

• h\E) = 4; 

• h^{detE) = 5 and det E is generated; 

• E is generated; 

• the canonical homomorphism H^{E) — )■ H^{detE) is surjective; 

• Dho(^e){E)=E. 

Proof. If h^{E) > 5, then, by Proposition I2.4( i) and [TH Lemma 3.9], we have dE > 
de > d^, a contradiction; so h^{E) = 4. Proposition I2.4( ii) implies that h'^ldetE) > 5 
and that ddetE' > d^. Since ds = (^4, this shows that /i°(det-E') = 5 and det£' is 
generated; moreover E' = E and E is generated. It follows from ([6]) that h^{F) > 0. 
The remaining parts of the lemma now follow from Remark 12.51 and ([6]). □ 

Theorem 3.2. Suppose d^ < 2di. Then 

(i) if B{2,d4,A) 7^ 0, there exists a line bundle M G -8(1,^4,5) such that (f)M{C) 
is contained in a quadric; 

(ii) if d^ < 2di and there exists M G -8(1,^4,5) such that (f)M{C) is contained in a 
quadric, then 5(2,^4,4) 7^ 0. 

Proof (i) Let E E B{2, d^, 4). By Lemma [XT| E is generated with h^{E) = 4, so we 
have a morphism 

2 

^E-.C^ Gr(2,4) ^ ¥{/\H\Ey). 

The line bundle det E is also generated and /i''(det E) =5, so we have a morphism 

0dets:C-^P(//°(detE)*). 

Moreover the canonical homomorphism /\ H^{E) — )■ H^{detE) is surjective, so there 
is a canonical embedding of P(if°(det E)*) in P(/\^ H^{E)*) as a hyperplane, giving a 
commutative diagram 

C ^ H°{Ey) 
II u 
C ¥{H\deiEy) = ¥\ 

It follows that (t)AetE{C) is contained in the quadric Gr(2,4) fl P"^. 

(ii) Suppose that M satisfies the hypothesis of (ii) and let g be a quadric containing 
4>m{C) defined by an element [q] of the kernel of the canonical map 

(8) ^ : S^H\M) H'^iM^). 

We can choose a linear subspace W of H^{M) of dimension 3 such that W generates 
M and the kernel N of the linear map W ® H^{M) — )■ H^{M'^) has dimension > 4. 
For this, first choose a line i on q which does not meet (f)M{C) (a simple dimensional 
calculation shows that such lines exist). Now let W be the 3-dimensional subspace of 
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H^{M) which annihilates the 2- dimensional subspace of H^{M)* defined by i. The 
fact that i does not meet (j)M{C) implies that W generates M, while the fact that i lies 
on q implies that the image of W ^ H^{M) in S'^H^{M) contains [q\. It follows that 
the image of in S'^H^{M) contains [q]. Since the kernel of the map N — )■ S'^H^{M) 
is /\^ W, it follows at once that dim > 4. 

Now define E* to be the kernel of the evaluation map W ^ M, so that we have 
an exact sequence 

(9) — yE* — yW(^0 — yM — ^ 

and det E^ M. Tensoring © by M and recalling that E* (g) M ^ E, we obtain 

(10) — yE — yW^M — y — ^0. 

So = and > 4. By , (E*) = and E is generated, so any quotient 

line bundle L of E has hP{L) > 2. So di > di and E is stable. □ 

Remark 3.3. (i) If d^ = 2di, the argument of (ii) is still valid except that there is now 
the possibility that E is strictly semistable. In this case, we have an exact sequence 

— y L — y E — y L' — ^0, 

with L, L' of degree di with = = 2; moreover L® L' = M. li L = L' 

and C is Petri, this implies that h^{M) = and hence h^{M) < 4 since 2di < g + 3; 
this is a contradiction. For a general curve of even genus > 4, Voisin has shown [22| 
Proposition 4.1(i)] that, if L ^ L', then h^{L O L') = 1; it follows that /i°(L (g) L') = 4, 
again a contradiction. The condition (i4 = 2di holds for general curves of genera 10, 12 
and 14, so in these cases we can say that -8(2, + 2, 4) 7^ if and only if there exists 
M G B{1, g + 2,5) such that 4>m{C) is contained in a quadric. 

(ii) Suppose ^4 = 2di, M G -8(1, d^, 5) and (puiC) is contained in a quadric q. Then 
q cannot have rank < 2 since (f)M{C) is non-degenerate. If q has rank 3 or 4, then 
M = L® L' with /i°(L) = h^{L') = 2 (the fine bundles L and L' correspond to the 
two systems of planes lying on q when the rank is 4; when the rank is 3, we have 
only one system of planes and L = L'). It follows that, if M ^ L ®) L', then 0m(C) 
cannot be contained in a quadric of rank < 4. Since every pencil of quadrics contains 
members of rank < 4, this means that, in this case, any quadric containing 0m (C*) is 
unique and has rank 5. When C is Petri, 0m(C) can never be contained in a quadric 
of rank 3, since as we have seen, M = LP' with hP{L) > 2 implies h^{M) = and hence 
h^{M) < 4. 

Remark 3.4. Suppose ^4 < 2di, let E G -6(2,6/4,4) and write M = detE. For any 
subspace V of H^[E) of dimension 3 which generates E, we have an exact sequence 

— y M* — yV ®0 — y E — ^0. 

Dualising and using the fact that h^{E*) = 0, we see that V* is a subspace of H^{M). 
Now tensoring by M and writing W = V* yields a sequence (fTOl) . It follows that H^{E) 
can be identified with the kernel of the map W ® H^{M) — )■ H^{M'^). The image 
of N in S'^H^{M) has dimension 1 and therefore coincides with the kernel of the map 
ip of which defines the unique quadric q on which (puiC) lies (compare Remark 
I3.3( ii)). As in the proof of Theorem 13. 2[ we see that W corresponds to a line £ on g 
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not meeting ipuiC) and also that we can recover {E, V) from (M, £). Thus we obtain 
a bijective correspondence between the sets 

Ti := {{E,V)\E G 5(2,4,4), V C H^{E), dimV = 3, 1/ generates E} 

and 

T2 := {{MJ)\M e 5(1,^4, 5)1, </)A/(C) C g,£ a hne on q not meeting (/)Af(C)}. 

The sets Ti, T2 have natural structures of quasi-projective variety and the bijective 
correspondence then becomes an isomorphism / : Ti — )■ T2. The subvarieties of Ti, T2 
corresponding to fixed E and M respectively are (if non-empty) both 3-dimensional 
irreducible quasi-projective varieties. Note further that f{E,V) = {det E,i) for some 
i. It follows that / induces an embedding of B{2, d^, 4) in B{1, d^, 5). 

If c?4 = 2di, the same argument works, but we must now exclude from Ti those 
{E, V) for which det E = L(g)L' and from T2 those (M, i) for which M = L®L', where 
in both cases h^{L) = h^{L') = 2. 

Remark 3.5. If di computes 71 and d^ < 2di, then any E G 5(2, ^4, 4) has 'y(E) < 71. 
Moreover, by Corollary 12.6^ 'y{E) = 72. So this is a possible source of examples for 
which 72 < 7i. 

Remark 3.6. For a Petri curve C, the expected dimension of 5(2,^4,4) is 

f3{2, 4, 4) = 4c/ - 3 - 4(4 - (^4 + 2^ - 2). 
Substituting d^ = g + A — [f ] , we obtain 



(3{2,d4,4:) =5-4 



5J 



For > 10, this is negative and also d^ < 2di. If we fix M G 5(1,^4,5), we have 
h}[M) > 2 since d^ < g + 2. Osserman's result Theorem 1.3] gives a lower bound 

/3(2,d4,4)-(7 + 12 = 17-(7-4[| 

L5J 

for the variety {E G 5(2, ^4, 4) | det 5 = M}, which is still negative. So, if 5(2, ^4, 4) ^ 
0, this would show that Osserman's bound is not sharp even in the case where h^{M) = 
2. 

In many cases, we do however have an upper bound for dim5(2, d^, 4). 

Proposition 3.7. Suppose C is a Petri curve and either ^4 < 2di or d^ = 2di and no 
M G 5(1, di, 5) has the form M = L ^ L' with h^{L) = h^{L') = 2. Then 

\9~ 



L5J 



dim 5(2,^4, 4) < ^ - 5 

Proof. By Remark 13. 4[ we have 

dim 5(2,^4, 4) < dim 5(1, 6/4, 5) = g-h 



□ 



This holds in particular for any Petri curve of genus 11, 13 or > 15 since then 
di < 2di. It holds also for the general curve of genus 10, 12 or 14 by Remark [331 
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4. The case g = 10 

In this section, we prove the original main theorem of this paper as an apphcation 
of Theorem 13.21 

Theorem 4.1. 

(i) Let C be a general curve of genus 10. Then B{2, c?, 4) 7^ if and only if d> 13. 

(ii) There exist Petri curves of genus 10 for which B{2, 12,4) 7^ 0. 

Proof, (i) For a general curve of genus 10, we have di = 6 and d^ = 12; moreover, 
there exist non-isomorphic line bundles of degree 6 with = 2 (in fact, by Casteln- 
uovo's formula [H Ch V, formula (1.2)], there are precisely 42 isomorphism classes of 
such bundles). It follows from Propositions 12. II and 12.41 that 5(2, rf, 4) = for d < 12 
and B{2, rf, 4) 7^ for d > 12. It remains to consider B{2, 12, 4). 

Suppose that B{2, 12,4) 7^ 0. Then, by Theorem 13. 2 ( i). there exists a line bundle 
M e B{1, 12, 5) such that 4>m{C) is contained in a quadric, in other words the map ip 
of ([8]) is not injective. Since S^H^{M) and H'^{M^) both have dimension 15 (the first 
since h^{M) = 5, the second by Riemann-Roch), this means that ip is not surjective. 
However, for a general curve C, ip is always surjective [22 > Proposition 4.2]. Hence 
5(2,12,4) = 0. 

(ii) For any genus g, there exists a Petri curve C which lies on a K3 surface S 
and whose class generates Pic 5* [11]. For g even, g > 10, it follows from the proofs 
of (22l Propositions 4.1, 4.12] that the hypotheses of [22, 3.1] are satisfied. Now let 
M G -5(1, 12, 5). Then, by [22i Theorem 0.3, Proposition 3.2] (our M becomes Kc — L 
in Voisin's notation) (see also [23]), the map ip is not surjective. When g = 10, this 
implies as above that ip is not injective and so (pM^C) lies on a quadric. It follows from 
Theorem [SSKii) and Remark [S3] that 5(2, 12, 4) 7^ 0. □ 

Proposition 4.2. Let C be a general curve of genus 10. Then there exists a stable 
bundle with 7(5) = 72 if and only if there exist line bundles M , M' with 

(11) dM = dM' = 12, /i°(M) = /i°(M') = 5 
such that 

(12) 5°(M) (g) H'^iM') H^{M ® M') 
is not surjective. 

Proof. We know already that, for a general curve of genus 10, 72 = 71 = 4 (see [T0| 
Proposition 3.8]). Theorem 14.11 shows that a stable bundle 5 of rank 2 with h^{E) = 4 
has 7(5) > |. Thus, if 5 is a stable bundle computing 73, we must have h^{E) = 2 + s 
with s > 3; moreover, by definition of 72, dE <2g — 2 = 18. If 5 has no line subbundle 
with h^{L) > 2, then, by [ISi Lemma 3.9], 

dE > d2s > da + 2s - 6 = 9 + 2s 

and so 7(5) > | again. On the other hand, if 5 has a line subbundle L with h^{L) > 3, 
then, by stability, dE > 2dL > 2d2 = 18, a contradiction. It follows that 5 can be 
expressed as a non-trivial extension 

(13) 0^L^5^M-^0, 
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where = 2 and hence dL > di = 6. We therefore require dg^i < du < 12. Since 

(i4 = 12, this imphes s < 5. The values s = 3 and s = 4 give du > 9 and dM > H 
respectively and a simple calculation gives 7(-E) > | once more. The only remaining 
possibility is s = 5, in which case we could have 7^; = 4 if all the above inequalities 
are equalities. Writing M' = K ^ L*, this is equivalent to ffTTl) . Moreover h^{E) = 7, 
so all the sections of M lift to E; it follows that the class of the extension f|T3l) belongs 
to the kernel of the canonical map 

H\M* ® L) ^ Rom{H^{M), H\L)). 

Thus this map is not injective. Dualising, we see that (fT2|) is not surjective. 

Conversely, suppose M and M' exist satisfying flTUl) such that f[T^ is not surjective. 
Then, if we write L = K^M'*, there exists a non-trivial extension (fT3|) with h^{E) = 7. 
Then 7(-E) = 4 and it is easy to check that E is stable. □ 

It is an interesting question as to whether line bundles M, M' as in Proposition 14.21 
can exist. Note that, when M = M', f[T21) is equivalent to asserting that the map ijj 
of ([H]) is not surjective. This cannot happen on a general curve of genus 10 by [221 
Proposition 4.2]. 

5. Curves of odd genus 
Let C be a Petri curve of odd genus g > 3. Note that, for such a curve, di = so 

/3(1, di,2)=g-2(^2- ^ + g-i^=i. 

There are therefore infinitely many non-isomorphic line bundles L of degree di with 
h%L) = 2. 

For g = 3, we have di = 3, d^ = 7, so we are in case (a) of Remark 12.71 and 

• B{2, rf, 4) ^ if and only iid>6. 

• 5(2, 4) ^ if and only iid>7. 

For g = 5,7 and 9, we are in case (b) with d^ = g + 3 = 2di. 
Proposition 5.1. Let C be a Petri curve of genus g = 5,7 or 9. Then 

(i) B{2, c/, 4) ^ if and only ifd>g + 3; 

(ii) B{2,d,A)^%ifd>g + A; 

(iii) if g = 5, B{2,d,'i) ^ ^ if and only if d > 8; moreover, if E E 5(2,8,4), then 
deiE^K and dim 5(2, 8, 4) = 2. 

Proof, (i) and (ii). Since d/^ = 2di and there are infinitely many non-isomorphic line 
bundles L of degree di with h^{L) = 2, it follows from Propositions 12.11 and 12.41 that 
(i) and (ii) hold. 

(iii) Suppose now g = 5 and E G 5(2,8,4); then by Lemma [3.11 h^{(\eiE) = 5. It 
follows at once that det5 = K. The other parts of (iii) now follow from [2]. □ 
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Remark 5.2. For g = 5, the strictly semistable locus B{2, 8, 4)\i?(2, 8, 4) is isomorphic 
to 5*^5(1,4,2) and therefore has dimension 2. Thus B{2,d,4) has two components, 
each of dimension 2, which intersect in a subvariety of dimension 1 (the points of this 
subvariety are given by bundles of the form L © {K ® L*) with L G -6(1, 4, 2)). 

Remark 5.3. For g = 7 and g = 9, the argument from [2] does not apply. For any 
M G B{l,g + 3, 5), we have h°{M^) = g + 7. For 51 = 7, it follows that the map ^ of (0) 
cannot be injective, so 4>m{C) is contained in a quadric. However, since 10, 5) = 2, 
it is possible that, for all M G 5(1, 10, 5), M = L (g) L' for some L, V G 5(1, 5, 2) and 
the method of Theorem 13.21 may yield only strictly semistable bundles. For = 9, we 
have /3(1, 12, 5) = 4, so there exist M G 5(1, 12, 5) which are not of the form L ® V . 
However, we now have h^{M'^) = 16, so (j)M{C) may not be contained in a quadric 
and again the argument of Theorem 13.21 and Remark 13.31 may not yield any bundles in 
5(2,12,4). 

Remark 5.4. If g > 11, we are in case (c) and < 2di. It follows that any E G 
5(2, (i4, 4) has 7(5) < 71. Moreover, by [TOl Theorem 5.2], 7(5) = 73. In particular, 
in genus 11, we have di = 7 and c/4 = 13. According to Theorem 13.21 5(2, 13,4) 7^ 
if and only if there is a non-degenerate morphism C — )■ of degree 13 whose image is 
contained in a quadric. It is an interesting question to determine whether this is true 
for all Petri curves of genus 11, for some but not all Petri curves or never. 

6. COHERENT SYSTEMS 

We recall that a coherent system of type (n, d, k) on C is a pair (5, V^), where 5 is a 
vector bundle of rank n and degree d and V is a. fc-dimensional subspace of H^{E). For 
any real number a > 0, the coherent system is a-stable if, for every proper subsystem 
(5, W), with F of rank r, 

dp dimW d k 
h a < — h a—. 

r r n n 

There exists a coarse moduli space G{a;n,d,k) for the a-stable coherent systems of 
type (n, d, k) (see j3] for a discussion of the general theory of coherent systems on 
curves) . 

A possible way of constructing bundles in 5(2, d, 4) is to construct coherent systems 
of type (2,0?, 4) and then use the methods of [3] to show that the underlying bundles 
are stable. It turns out that this doesn't help with the problem considered earlier, but 
one still obtains interesting results by interpreting the problem in terms of coherent 
systems. 

We start by recalling a definition from [1]: 

U{n, d, k) := {(5, V)\{E, V) G G{a\ n, d, k) for all a > and 5 is stable}. 

Proposition 6.1. Suppose d < 2di + l and (5, V) is a coherent system of type (2, d, 4). 
The following are equivalent: 

(i) (5, V) G G{a; 2, d, 4) for some a > 0; 

(ii) 5 is stable; 

(iii) {E,V)eU{2,d,4). 



STABLE BUNDLES OF RANK 2 13 

Proof, (i)^(ii). If {E, V) is a-stable and L is a subbundle with cIl > then cIe/l < di, 
so h°{E/L) < 2 and hence dim(if°(L) nV)>2. This contradicts the a-stabihty of E, 
proving that E is stable. 

(ii) ^(iii). Every hne subbundle L of E has degree < di and hence h^{L) < 2. It 
follows that {E, V) is a-stable for all a > 0. 

(iii) ^(i) is obvious. □ 

Remark 6.2. One can show easily that, under the hypotheses of Proposition 16. ![ there 
are no actual critical values in the sense of jS] Definition 2.4]. 

Remark 6.3. On a general curve of genus 5^ > 3, or more generally whenever di 
computes 71, Proposition 16.11 is proved for d < 2di in P Theorem 1.1]. 

To handle coherent systems whose degree is greater than 2di + l, the following lemma 
will be useful. 

Lemma 6.4. Let (Li, Vi), {L2,V2) be coherent systems of type (1,6?/,, 2) and 

— > Li®L2 — > E — VT — ^0 
an extension with r a torsion sheaf and E a stable bundle. Then 

{E,Vr®V2)eU{2,dEA). 

Proof. Suppose (F, W) is a coherent subsystem of [E, Vi © V2) with F of rank 1. Then 
W cVi® 1/2, so (F n (Li © L2), W) is a coherent subsystem of (Li © L2, Vi © V2); it 
follows that dim < 2. On the other hand, by stability of E, dp < ^. So {E, © V2) 
is a-stable for all a > 0. □ 

Remark 6.5. The stable bundles E constructed in the proof of Proposition I2.1( ii) 
all satisfy the conditions of Lemma 16.41 and therefore give rise to coherent systems 

(F,\/)ef/(2,rfs,4). 

We can now interpret our results in terms of coherent systems, beginning with the 
case g = 2. 

Theorem 6.6. Let C be a curve of genus 2. Then 

(i) if d <5, then G{a; 2, c/, 4) = for all a > 0; 

(ii) ifd>6, then f/(2,rf,4) 0. 

Proof, (i) follows at once from Propositions 12.31 and 16.11 

(ii) For d > 7, this follows from Proposition I2.1( ii) and Remark 16.51 For d = Q, 
{E, V) can be constructed from the sequence (jlj) with E stable. Any line subbundle 
L' of E has degree di, < 2 and therefore h^{L') < 2; hence {E, V) e f/(2, 6, 4). □ 

Remark 6.7. For d < 3 and d > 6, this is proved in [4]; for d = 4 and d = 5, the 
result in ||4j is slightly weaker than ours. 

Theorem 6.8. For any curve C, 

(i) t/(2,d,4) ^^ifd> 2di + 3; 
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(ii) if there exist two non-is amorphic line bundles Li, L2 of degree di with h^{Li) = 
2, then U{2, rf, 4) ^ for d>2di + l; 

(iii) ife< 2di and B{2, e, 4) ^ 0, then U{2, rf, 4) 7^ for d > e; 

(iv) if d < min{2(ii, 6/4}, then G{a] 2, ci, 4) = for all a > 0. 

Proof, (i) and (ii) follow from Proposition I2.1( ii) and Remark 16.51 

(iii) We need only prove that t/(2,e,4) and U{2,e + 1,4) are non-empty, since the 
results for d > e + 2 can then be obtained by tensoring by effective line bundles. For 
these cases, non-emptiness follows from Propositions I2.1( iv) and 16. 1[ 

(iv) follows from Propositions I2.4( iii) and 16.11 □ 

Remark 6.9. Theorem I6.8( ii) was proved for a general curve by Teixidor using de- 
generation methods [21j . 

Theorem 6.10. Suppose ^4 < 2di. Then 

(i) if G{a; 2, 0/4, 4) 7^ for some a > 0, there exists a line bundle M G -8(1, ^4, 5) 
such that (puiC) is contained in a quadric; 

(ii) if d/j^ < 2di and there exists M G 5(1,^4,5) such that (puiC) is contained in a 
quadric, then f/(2,(i4,4) 7^ 0. 

Proof. This follows at once from Theorem 13.21 and Proposition 16.11 □ 
Theorem 6.11. Let C be a general curve of genus 10. Then 

(i) t/(2,d,4) ^^ifd> 13; 

(ii) Cja; 2, 12, 4) = for alla>0. 

However 

(iii) there exist Petri curves of genus 10 for which U{2, 12,4) 7^ 0. 

Proof, (i) is a special case of Theorem I6.8( ii). 

(ii) and (iii) follow from Theorem 14.11 and Proposition 16.11 □ 
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Abstract. This paper contains results on stable bundles of rank 2 with space of 
sections of dimension 4 on a smooth irreducible projective algebraic curve C . There 
is a known lower bound on the degree for the existence of such bundles; the main 
result of the paper is a geometric criterion for this bound to be attained. For a 
general curve C of genus 10, we show that the bound cannot be attained, but that 
there exist Petri curves of this genus for which the bound is sharp. We interpret the 
main results for various curves and in terms of Clifford indices and coherent systems. 
The results can also be expressed in terms of Koszul cohomology and the methods 
provide a useful tool for the study of the geometry of the moduli space of curves. 



This paper began life some years ago with a proof that, on a general curve of genus 
10, there does not exist a stable bundle of rank 2 and degree 12 with 4 independent 
sections, but that such bundles do exist on certain Petri curves of genus 10. The 
motivation for this came partly from a paper of C. Voisin [30] concerning bundles 
of rank 2 with canonical determinant and partly from results involving the Clifford 
index contained in [23]. In fact, the classical Clifford's theorem for line bundles has 
been extended to semistable bundles of higher rank by G. Xiao [321 p. 477] (see also 
[71 Theorem 2.1]) as follows: if ii^ is a semistable vector bundle of rank n and slope 
/X = ^ on a smooth projective curve C of genus g such that < /i < 2(7 — 2, then 
hP{E) < f + n. This result was improved by R. Re [27| and further refined by the 
second author [23] to a version which takes into account the Clifford index Cliff (C) of 
C. In [23], it is conjectured that, for (7 > 4 and E semistable. 
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Note that, for a general curve of genus 10, the Chfford index is 4, so, when n = 2, the 
main part of the conjecture becomes 

h\E) < ^ - 2 for 6 < < 12. 

In particular bundles of degree 12 with = 4 represent a "corner point" for these 
inequalities. 

The result mentioned at the beginning of the previous paragraph was never published 
and, as far as we are aware, has not been published since except in a brief form in the 
survey article p^. However, there have been several developments that add to the 
interest of the result and also place it in a more general context. The most important 
of these has been the increasing understanding that higher rank Brill-Noether theory 
can provide insights into the geometry of the moduli space of curves through the 
medium of Koszul cohomology (see, for example, [H [2]); in this respect the present 
paper adds to the evidence that higher rank Brill-Noether theory is not a consequence 
of the classical theory for rank 1. Related to this are the broadening of higher rank 
Brill-Noether theory into the study of coherent systems on curves (in fact the form of 
the result in [21] is in this context), the introduction of higher rank Clifford indices 
(see below for details) leading to a reformulation of the conjecture of [23] and the fact 
that, very recently, a counter-example to the conjecture for n = 3 has been noted [T5] . 
For n = 2, we do not construct any counter-examples here, but our results do suggest 
where one might look for them; for recent developments including the construction of 
such counter-examples, see section [71 

A final reason for interest in the construction of bundles of rank 2 with many sections 
is that new estimates for the dimensions of Brill-Noether loci with fixed determinant 
have been obtained, also very recently, by B. Osserman [25] . 

In order to state our results, we need some definitions. Let C be a smooth irreducible 
projective algebraic curve of genus g > 2 defined over the complex numbers, and let 
M{n,d) (resp. M{n,d)) denote the moduli space of stable vector bundles (resp. S- 
equivalence classes of semistable vector bundles) of rank n and degree d over C. The 
Brill-Noether locus B{n, d, k) is the subvariety of M(n, d) defined by 

B{n, d, k) = {E e M{n, d) \ h^{E) > k}. 

Corresponding subvarieties B{n,d,k) of M{n,d) can be defined similarly; note that 
B{n, d, k) = B{n, d, k) when gcd(n, d) = 1. The most fundamental question concerning 
these loci is to determine when they are non-empty (see [Hj for a survey of results on 
this and other questions in the Brill-Noether theory of vector bundles). In particular, 
the expected dimension of B{n, d, k) is given by the Brill-Noether number 

/3{n, d, k) ■=n^{g-l) + l-k{k-d + n{g - 1)). 

Every component of B{n,d,k) has dimension > P{n,d,k), but, even on a general 
curve, it is not true that /3(n, d,k) > implies the non-emptiness of B{n, d, k), nor is 
the converse of this result true. The purpose of this paper is to contribute to the study 
of the question of non-emptiness in the first case for which the answer is not completely 
known, namely n = 2, k = 4. 
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For general curves, M. Teixidor i Bigas has obtained non-emptiness results using 
degeneration methods [2S] and L. Brambila-Paz has obtained both emptiness and non- 
emptiness results by other methods However we shall work in a wider context. For 
this, we need some definitions from [17]. For any vector bundle E of rank n and degree 
(i on C, we define 

7(E) ■.= -(d- 2ih\E) - n)) = 12(E) - + 2. 

If C has genus > 4, we then define, for any positive integer n, 

E semistable of rank n 



aiff„(C) := mm ^^{E) ^o(^) > ^(^) < g 

(this invariant is denoted in [T7j by 7^). Note that Cliff i(C) = Cliff (C) is the usual 
Clifford index of the curve C. Moreover, as observed in [T71 Proposition 3.3 and 
Conjecture 9.3], the conjecture of [23] can be restated in a slightly weaker form as 

Conjecture. Cliff„(C) = Cliff(C). 

Next, the gonality sequence {d^} of C is defined by 

dr := min{degL | L a line bundle on C with h^{L) > r + 1}. 

We say that d^ computes Cliff (C) ii d^ < g — 1 and Cliff (C) = dr — 2r. By classical 
Brill-Noether theory, we have always 



(1) dr<g + r 
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r + 1 



This formula is valid for all g. 

We need also the concept of a Petri curve. In general, for any line bundle L on C, 
we consider the Petri map 

H\L) ® H\K L*) — > H\K) 

given by multiplication of sections. A curve C is said to be a Petri curve if the Petri 
map is injective for every line bundle L on C. We shall need the following facts 
concerning Petri curves: 

• the general curve of any genus is Petri; 

• there exist Petri curves lying on K3 surfaces (see [20]): 

• on a Petri curve, the inequalities of ([T]) are all equahties. 

We now summarise the results of the paper. In section [21 we obtain results on 
semistable and stable bundles of rank 2 with > 4, especially those of degree < 2di 
(note that such a bundle always has degree > min{2(ii, c?4} (see Proposition 12.41 below 
and compare [TTJ Theorem 5.2])). In particular we determine the emptiness or non- 
emptiness of -6(2, d, 4) and -8(2, d, 4) in many cases (Proposition 12. II and Remark l2.7p . 
We also discuss these results for various different curves (Examples I2.8H2TT(1 . 

In section [3l we suppose d^ < 2di and concentrate on stable bundles of this type 
which have the minimum possible degree ^4. This leads to our first main theorem: 
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Theorem 13.21 Suppose d/^ < 2di . Then 

(i) if B{2,d4,A) 7^ 0, there exists a line bundle M G -8(1,^4,5) such that 0m(C') 
is contained in a quadric; 

(ii) if d^ < 2di and there exists M G 5(1,^4,5) such that (pAiiC) is contained in a 
quadric, then 5(2,^4,4) 7^ 0. 

(Here, for any generated line bundle M, (pM denotes the morphism C P(i^°(M)*) 
defined by evaluation of sections of M.) We relate this result to possible counter- 
examples to the conjecture Cliff 2(C) = Cliff (C) (Remark 13 .Sp and, for Petri curves, to 
the possible existence of non-empty Brill-Noether loci for which 

/3(2, d, 4) := % - 3 - 4(4 - + 2^ - 2) 

is negative (Remark 13. 6p . We obtain also an upper bound for dim _B(2, ^4, 4) for a 
general curve of genus g > 10 (Proposition 13. 7p . 

In section HI we prove the main result of the original version of this paper, namely 

Theorem 14.11 (i) Let C be a general curve of genus 10. Then 

B{2, rf, 4) 7^ d > 13 ^ /3(2, d, 4) > 0. 

(ii) There exist Petri curves of genus 10 for which 5(2,12,4) 7^ 0. Moreover 
/3(2,12,4)<0. 

In section [5l we discuss curves of odd genus and obtain an interesting example for g = 
5 (Proposition 15. ip . In section [6|, we show how our results can be interpreted in terms 
of coherent systems. Finally, in section [71 we comment on the exciting developments 
that have taken place since this paper was completed. 

Throughout the paper, C is a smooth irreducible projective curve of genus g > 2 
defined over an algebraically closed field of characteristic 0. The canonical bundle on 
C is denoted by K. For any vector bundle E on C, we write ds for the degree of E. 

We thank the referee for a careful reading and some useful comments. 

2. Bundles of rank 2 with 4 sections 

Proposition 2.1. Let C be a curve of genus g >2. Then 

(i) 5(2,2f/i,4)^0; 

(ii) B{2,d,A) 7^ if d > 2di +3; moreover, if there exist two non-isomorphic line 
bundles Li, L2 of degree di with h^{Li) = 2, then B{2, rf, 4) 7^ for d > 2di + 1; 

(iii) ifd<2di, then B{2,d,A) = B{2,d,A); 

(iv) ife< 2di and B{2, e, 4) ^ 0, then 5(2, rf, 4) ^ for d>e. 

Proof, (i) By definition, there exist line bundles on C of degree di with = 2. Let 
Li, L2 be two such line bundles. Then Li ©L2 is semistable of degree 2di with /i° = 4. 

(ii) Consider extensions 

(2) ^ Li® L2 ^ E ^ T ^ 0, 

where Li, L2 are non-isomorphic line bundles of the same degree with h^{Li) = 2 and 
r is a torsion sheaf of length t > 0. Such extensions are classified by pairs (61,62), 
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where Cj G Ext (r, Li). When t = 1, it is easy to see that E is a. stable vector bundle 
provided ei and 62 are both non-zero. For any t > 0, it is in fact true that ii^ is a 
stable vector bundle for the general extension ([2]) |22l Theoreme A. 5]. This completes 
the proof when Li, L2 have degree di. When there exists only one line bundle L of 
degree di with = 2, we take Li = L{p), L2 = L{q) in ([2]), where p, q are distinct 

points of C. 

(iii) Suppose that d < 2di and that E is semistable of degree d. If E is strictly 
semistable, then d is even and there exists a line subbundle L of of degree |. Now 
f < di, so h^{L) < 2 and W{E/L) < 2. This contradicts the fact that h^{E) > 4, so 
E cannot be strictly semistable. 

(iv) It is sufficient to prove that 5(2, e + 1,4) 7^ 0, since we can then obtain the 
result by tensoring with effective line bundles. For this, let E G -8(2, e, 4) and consider 
extensions 

(3) O^E^F^T^O, 

where F is a vector bundle and r has length 1. Every line subbundle L of E has 
dL < ^ < di, so h'^{L) < 2. Hence every quotient line bundle L' of E has h^{L') > 3. 
It follows that d^i > d2, so di < e — d2- Thus every line subbundle of F has degree 
<e-d2 + l<^ = /i(F) since e<2di< 2^2 - 2. So F is stable. □ 

Remark 2.2. For a Petri curve of genus (7 > 3, there exist non- isomorphic Li, L2 of 
degree di with h?{Li) = 2 and Proposition I2.1( ii) states that 5(2,0?, 4) is non-empty 
foTd>g + 3 when g is even and for d > g + 4 when g is odd. This was previously 
proved by Teixidor for a general curve using degeneration methods [28]. This implies 
the result for odd d for any curve on which di takes its generic value g + 1 — [|] . On 
the other hand, for a hyperelliptic curve (and in particular any curve of genus 2), there 
is only one line bundle L of degree di = 2 with = 2. The situation for g = 2 is 
described in the following proposition. 

Proposition 2.3. Let C he a curve of genus 2. Then 

• B{2, 4) 7^ if and only zfd = Aord>6; 

• 5(2, ci, 4) 7^ if and only zfd>6. 

Proof. Suppose first that 5 is a semistable bundle of rank 2 and degree d. li d < 3, 
then the Clifford theorem of [32] gives h^{E) < 3. For d = 5, we have h^{E) = 3 by 
the Riemann-Roch theorem. On the other hand, if = 4 or c? = 6, there certainly 
exist semistable bundles E with h^{E) = 4, namely K (B K and Li © L2, where Li, L2 
are any line bundles of degree 3. By Proposition 12. l( ii) . 5(2, 4) 7^ for c? > 7. Since 
i^©i^' is the only semistable bundle of degree 4 with = 4 (see [27]), it remains only 
to show that there exists a stable bundle E of degree 6 with h^{E) > 4. For this we 
consider extensions 

(4) ^ L ^ E ^ M ^ 0, 

where degL = 2 and degM = 4. Suppose that L ^ K; then h^{L) = 1 and h^{L) = 0. 
On the other hand, h^{M) = 3, so it follows from the cohomology sequence of (jl]) that 
h°{E) = 4. Moreover, it is a standard fact (see, for example, [16]) that, for the general 
extension (j4]), 5 is stable. □ 
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We now return to the case of an arbitrary curve C of genus g > 2. 

Proposition 2.4. Suppose that E G B{2,d,A) with d < 2d\. Let E' be the image of 
the evaluation morphism H^{E) ® O ^ E . Then 

(i) h^{L) < 1 for every line suhhundle L of E; 

(ii) h^ldetE') > 5; 

(iii) d> d^. 

Proof (i) Since E is stable of degree d < 2di, every line subbundle L of E has degree 
di < di and so h^{L) < 1. 

(ii) [This follows directly from (i) and [261 Lemma 3.9]; for the convenience of the 
reader and for future reference, we include a proof.] It follows from (i) that E' is of 
rank 2 and h^{E'*) = (otherwise O would be a direct summand of E' and the other 
factor would be a line bundle L with h^{L) > 3). li E' = E, then E' is stable by 
hypothesis. If E' ^ E, any proper quotient of E' is a non-trivial generated line bundle 
and therefore has degree > di > fi{E'). So again E' is stable. 

Now consider the exact sequence 

(5) ^ Dv{E'y ®0 E' ^0, 

where is a 4-dimensional subspace of H^{E') which generates E'. Applying /\^, we 
obtain the two sequences 

2 

(6) O^F -> /\V^O ^detE' ^0 
and 

2 

(7) 0^ /\Dv{E'y -¥ F -¥ DviE'Y ^E' ^0. 

Now, from ([5]), Dv{E') has rank 2, is generated and satisfies h^{Dv{E')) > 4 and 
h^{Dv{E'y) = 0. It follows that any proper quotient of Dv{E') is a non-trivial 
generated line bundle and therefore has degree > di > fi{Dv{E'y. So Dv{E') is 
at least semistable. Since n{Dy{E'y = fi{E') and E' is stable, this implies that 
h^{Dv{E'y ®E') < 1. Hence, by ([7D, /i°(F) < 1 and, by (P, /i°(detE') > 5. 

(iii) Since det E' is a subsheaf of det E, (iii) follows from (ii) and the definition of 

Remark 2.5. Under the same hypotheses, suppose that h^{F) > 0, where F is defined 
by dHD- Then h^{Dv{E'y (g) E') > by (0). From the proof of Proposition ElKii), we 
see that E' is stable and Dy{E') is semistable, and these two bundles have the same 
slope. So Dv{E') ^ E' and h\F) = 1. 

We have the following corollary, which is also an immediate consequence of [T71 
Theorem 5.2]. 



Corollary 2.6. Let E be a semistable bundle of rank 2 with h^{E) = 4. Then 'y{E) > 

2 



min{Cliff(C),f -2}. 



STABLE BUNDLES OF RANK 2 



7 



Proof. From the definition of 'y{E), we see tliat it is sufficient to show that (Ie > 
min{2(ii, ^4}. This follows at once from Propositions I2.4( iii) and I2.1( iii). □ 

Remark 2.7. Propositions 12.11 and 12.41 lead to the following trichotomy: 

(a) > 2di. If also there exist two non-isomorphic line bundles of degree di with 
/i° = 2, then 5(2, rf, 4) ^ if and only ii d > 2di and B{2, rf, 4) ^ if and only 
if > 2di + 1. If there is only one line bundle of degree di with = 2, the 
same holds except that B{2,2di + 1,4) and B{2,2di + 2,4) could possibly be 
empty (see Proposition 12.31 for a case in which B{2,2di + 1,4) = 0). 

(b) di = 2di. The same holds as in case (a) except that it is now possible that 
5(2,2rfi,4) ^ 0; when this happens, 5(2, 4) 7^ if and only li d> 2di (see 
Proposition I2.1( iv) ) . 

(c) di < 2di. Let dmm be the minimum value of d for which B{2, d, 4) ^ 0. Then, by 
Propositions O and [MKiii), d^ < d^^^ < 2di. If Cm < 2di, then B{2,d,4) ^ 
if and only if c? > dmin- If dmin = 2c?i, the situation is the same as in case (b). 

Example 2.8. If C is a Petri curve of genus g, we have dr = g + r — . It follows 
that, if g is even, then d^ > 2di for g < S. For g = 4, 6, 8, case (a) applies and 
B{2, ci, 4) 7^ if and only if d > 2di + 1. If g = 10, 12, 14, then case (b) applies and it 
may happen that B{2, 2di, 4) 7^ 0. The case g = 10 will be discussed fully in section HI 

Example 2.9. If C is a smooth plane curve of degree S > 5, then di = 6 — 1 and 
di = 26 — 1, so we are in case (a). Moreover there exist infinitely many line bundles of 
degree di with /i° = 2, so B{2, rf, 4) ^ if and only ii d > 26 ~ 2 and B{2, rf, 4) ^ if 
and only if d > 26 — 1. 

Example 2.10. If C is a curve of Clifford dimension > 4 (i.e. none of di, ^2, d^ 
computes Cliff(C)), then we are in case (c). In fact, d^ computes Cliff(C) for some 
r > 4. By [ini Corollary 3.5], d,. > 4r - 3 > 3r. So 

4 < 4 - r + 4 < 2rf^ - 4r + 4 = 2 Cliff (C) + 4 < 2di. 

If C has Clifford dimension 3, then C is an intersection of 2 cubics in (see [21]) and 
has genus 10 with Cliff (C) = 3. It follows that di = 6 and di = 12, so we are in case 
(b). 

3. Bundles of degree di 

In this section, we consider the case where di < 2di and ds = di and state and 
prove our first main theorem. 

Lemma 3.1. Suppose di < 2di and E G -8(2,^4,4), then 

• h\E) = 4; 

• /i°(det£') = 5 and det E is generated; 

• E is generated; 

• the canonical homomorphism /\^ H^{E) — )■ if (det 5) is surjective; 
. Dho^e){E)^E. 



8 



I. GRZEGORCZYK, V. MERCAT, AND P. E. NEWSTEAD 



Proof. Suppose E G B(2,d4^,4) with h^{E) = 2 + s. By Proposition I2.4( i) . we know 
that hP{L) < 1 for every hne subbundle L of E. It follows from pSl Lemma 3.9] that 
/i°(det £") > 2s + 1 and therefore (Ie = d^^tE > '^2s- This is a contradiction if s > 2; so 
hP{E) = 4. Proposition I2.4( ii) implies that h^{detE) > 5 and that ddetE' > d^. Since 
dE = d^, this shows that h^{detE) = 5 and detE is generated; moreover E' = E and 
E is generated. It follows from ([6]) that h^{F) > 0. The remaining parts of the lemma 
now follow from Remark 12.51 and ([6]) . □ 

Theorem 3.2. Suppose d^^ < 2di. Then 

(i) if B{2,d4,4) 7^ 0, there exists a line bundle M G -8(1,^4,5) such that (j)M{C) 
is contained in a quadric; 

(ii) if d^ < 2di and there exists M G 5(1,^4,5) such that 0m(C) is contained in a 
quadric, then _B(2,c/4,4) 7^ 0. 

Proof, (i) Let E G 5(2, 6/4, 4). By Lemma IXT| E is generated with h^{E) = 4, so we 
have a morphism 

2 

c^E-.C^ Gr(2, 4) ^ P(/\ H'^iEY). 

The line bundle deti^^ is also generated and h^{detE) = 5, so we have a morphism 

(l^detE : C^P(i/°(detE)*). 

Moreover the canonical homomorphism H^[E) — )■ if'^(detii^) is surjective, so there 
is a canonical embedding of P(i/°(det E)*) in P(/\^ H^{E)*) as a hyperplane, giving a 
commutative diagram 

C ^ H°{Ey) 

II u 

C P(i/0(detE)*) = Pl 

It follows that 0det£;(C) is contained in the quadric Gr(2,4) fl P''. 

(ii) Suppose that M satisfies the hypothesis of (ii) and let g be a quadric containing 
0Af(C) defined by an element [q] of the kernel of the canonical map 

(8) ^P : S^H\M) H\M^). 

We can choose a linear subspace W of H^{M) of dimension 3 such that W generates 
M and the kernel of the linear map W ® H^{M) — )■ H^{M'^) has dimension > 4. 
For this, first choose a line i on q which does not meet 0m (C*) (a simple dimensional 
calculation shows that such lines exist). Now let W be the 3-dimensional subspace of 
H^{M) which annihilates the 2-dimensional subspace of H^{M)* defined by £. The 
fact that i does not meet 0m (C*) implies that W generates M, while the fact that i lies 
on q implies that the image of W ^ H^{M) in S'^H^{M) contains [q\. It follows that 
the image of in S'^H^{M) contains [q]. Since the kernel of the map — )■ S'^H^{M) 
is /\^ W, it follows at once that dim > 4. 

Now define E* to be the kernel of the evaluation map W ®0 ^ M, so that we have 
an exact sequence 

(9) 0—^E* — >W®0 — yM — ^0 
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and det E = M. Tensoring ^ hj M and recalling that E* ig) M = E, we obtain 
(10) — >E — >W^M — > — ^0. 

So = and > 4. By ©, = and E is generated, so any quotient 

line bundle L of E has hP{L) > 2. So (ii > di and -E is stable. □ 

Remark 3.3. (i) If ^4 = 2di, the argument of (ii) is still valid except that there is now 
the possibility that E is strictly semistable. In this case, we have an exact sequence 

— > L — > E — > L' — ^0, 

with L, L' of degree di with /i°(L) = = 2; moreover L® L' = M. li L = L' 

and C is Petri, this implies that h^{M) = and hence h^{M) < 4 since 2di < g + 3; 
this is a contradiction. For a general curve of even genus g > 4:, Voisin has shown [30t 
Proposition 4.1(i)] that, if L ^ L', then h^{L L') = 1; since c^l^-L' = 2(ii = (7 + 2, it 
follows that h^{L ® i^') = 4, again a contradiction. The condition ^4 = 2(ii holds for 
general curves of genera 10, 12 and 14, so in these cases we can say that B{2, g+2, 4) 7^ 
if and only if there exists M G B{l,g + 2, 5) such that (puiC) is contained in a quadric. 

(ii) Suppose ^4 = 2di, M G -8(1, (^4, 5) and (puiC) is contained in a quadric q. Then 
q cannot have rank < 2 since (j)M{C) is non-degenerate. If q has rank 3 or 4, then 
M = L® L' with /i°(L) = h^{L') = 2 (the hue bundles L and L' correspond to the 
two systems of planes lying on q when the rank is 4; when the rank is 3, we have only 
one system of planes and L = L'). It follows that, if M L ®) L', then (pMiC) cannot 
be contained in a quadric of rank < 4. Since every pencil of quadrics in P*^ contains a 
member of rank < 4, this means that, in this case, any quadric containing 0m(C') is 
unique and has rank 5. When C is Petri, (f)M{C) can never be contained in a quadric 
of rank 3, since as we have seen, M = E^ with h^{L) > 2 implies h^{M) = and hence 
h^{M) < 4. 

(iii) It is of interest to note that the kernel of the map ip of can be identified 
with the Koszul cohomology group Ki^i{C, M). 

Remark 3.4. Suppose d^ < 2di, let E G 5(2,^4,4) and write M = detE. For any 
subspace V of H^{E) of dimension 3 which generates E, we have an exact sequence 

— > M* — >V®0 — > E — ^ 0. 

Dualising and using the fact that h^{E*) = 0, we see that V* is a subspace of H^{M). 
Now tensoring by M and writing W = V* yields a sequence fllOj) . It follows that H^{E) 
can be identified with the kernel of the map W H^{M) — )■ H^{M'^). The image 
of N in S'^H^{M) has dimension 1 and therefore coincides with the kernel of the map 
"0 of ([8]), which defines the unique quadric q on which 0m (C") lies (compare Remark 
I3.3( ii)). As in the proof of Theorem 13. 2[ we see that W corresponds to a line i on q 
not meeting (f)M{C) and also that we can recover [E, V) from {M,i). Thus we obtain 
a bijective correspondence between the sets 

Ti := {{E,V)\E G B{2,di,4),V C H\E), dimV = 3, \/ generates E} 

and 



T2 := {(M,£)|M G 5(1,^4, 5)1, 0m(C) Cq,ia line on q not meeting 0m(<^)}- 
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The sets Ti, T2 have natural structures of quasi-projective variety and the bijective 
correspondence then becomes an isomorphism / : Ti — )■ T2. The subvarieties of Ti, T2 
corresponding to fixed E and M respectively are (if non-empty) both 3-dimensional 
irreducible quasi-projective varieties. Note further that f{E,V) = {det E,i) for some 
£. It follows that / induces an embedding of 5(2,^4,4) in B{l,d4,5). 

If = 2di, the same argument works, but we must now exclude from Ti those 
{E, V) for which det E = L(g)L' and from T2 those (M, i) for which M = L(g)L', where 
in both cases h^{L) = h^{L') = 2. 

Remark 3.5. If di computes Cliff (C) and d^ < 2di, then any E G 5(2,^4,4) has 
7(E) < Cliff (C). Moreover, by Corollary EH 7(E) = Clifr2(C). So this is a possible 
source of examples for which Cliff 2(C) < Cliff (C). 

Remark 3.6. For a Petri curve C, the expected dimension of 5(2,^4,4) is 

/3(2, ^4, 4) = 4^ - 3 - 4(4 - c/4 + 2^ - 2). 
Substituting d^ = g + A — [|] , we obtain 

/3(2,d4,4)=5-4[f . 

L5J 

For g > 10, this is negative and also d^ < 2di. If we fix M G 5(1,^4,5), we have 
h^{M) > 2 since d/^ < g + 2. Osserman's result [25l Theorem 1.3] gives a lower bound 

P{2,d,A)-g + l2 = 17-g-A\^ 

L5J 

for the dimension of the variety {E G B{2,d4,A) \ detE = M}, which is still negative. 
So, if B{2, d^, 4) 7^ 0, this would show that Osserman's bound is not sharp even in the 
case where h^{M) = 2. 

In many cases, we do however have an upper bound for dimi?(2, ^4, 4). 

Proposition 3.7. Suppose C is a Petri curve and either d^ < 2di or d^ = 2di and no 

M G B{1, c/4, 5) has the form M ^ L ® V with h%L) = h^{L') = 2. Then 

dim 5(2,^4, 4) < ^ - 5 [- 

Proof. By Remark 13. 4[ we have 

dim 5(2,^4, 4) < dim5(l, c/4, 5) = fi- - 5 



□ 



This holds in particular for any Petri curve of genus 11, 13 or > 15 since then 
di < 2di. It holds also for the general curve of genus 10, 12 or 14 by Remark 13. 3[ 

4. The case g = IQ 



In this section, we prove the original main theorem of this paper as an application 
of Theorem 13.21 
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Theorem 4.1. 

(i) Let C be a general curve of genus 10. Then 

B{2, rf, 4) 7^ ^ > 13 ^ /3(2, d, 4) > 0. 

(ii) There exist Petri curves of genus 10 for which 5(2,12,4) ^ 0. Moreover 
/3(2,12,4)<0. 

Proof, (i) For a general curve of genus 10, we have di = Q and d^ = 12; moreover, 
there exist non- isomorphic hne bundles of degree 6 with = 2 (in fact, by Casteln- 
uovo's formula [3] Ch V, formula (1.2)], there are precisely 42 isomorphism classes of 
such bundles). It follows from Propositions 12. II and 12.41 that B{2,d,A) = for d < 12 
and 5(2, 4) 7^ for d > 12. It remains to consider 5(2, 12, 4). 

Suppose that 5(2,12,4) 7^ 0. Then, by Theorem 13. 2 ( i). there exists a line bundle 
M e 5(1, 12, 5) such that 4>m{C) is contained in a quadric, in other words the map ip 
of ([8]) is not injective. Since S'^H^{M) and H^{M'^) both have dimension 15 (the first 
since h^{M) = 5, the second by Riemann-Roch), this means that ip is not surjective. 
However, for a general curve C, ip is always surjective [SUl Proposition 4.2]. Hence 
5(2,12,4) = 0. 

Finally /3(2, rf, 4) = 4rf - 51 > d > 13. 

(ii) For any genus g, there exists a Petri curve C which lies on a K3 surface S 
and whose class generates Pic 5 [20]. For g even, g > 10, it follows from the proofs 
of |30l Propositions 4.1, 4.12] that the hypotheses of [301 3.1] are satisfied. Now let 
M G 5(1, 12, 5). Then, by [301 Theorem 0.3, Proposition 3.2] (our M becomes Kc — L 
in Voisin's notation) (see also [31]), the map ip is not surjective. When g = 10, this 
implies as above that ip is not injective and so 4>m{C) lies on a quadric. It follows from 
Theorem [S21(ii) and Remark ESI that 5(2, 12, 4) ^ 0. Finally, /3(2, 12, 4) = -3 < 0. □ 

Proposition 4.2. Let C be a general curve of genus 10. Then there exists a stable 
bundle E computing Cliff 2(C) if and only if there exist line bundles M, M' with 

(11) du = dw = 12, h^{M) = /i°(M') = 5 
such that 

(12) 5°(M) ® 5°(M') 5°(M ® M') 
is not surjective. 

Proof. We know already that, for a general curve of genus 10, Cliff 2(C) = Cliff (C) = 4 
(see [TTl Proposition 3.8]). Theorem 14.11 shows that a stable bundle E of rank 2 with 
/i°(5) = 4 has 7(5) > |. Thus, if 5 is a stable bundle computing Cliff2(C), we must 
have h^{E) = 2 + s with s > 3; moreover, by definition of Cliff2(C), d^ <2g — 2 = 18. 
If E has no line subbundle with h^{L) > 2, then, by [261 Lemma 3.9], 

dE > d2s > de + 2s - 6 = 9 + 2s 

and so 7(5) > | again. On the other hand, if E has a line subbundle L with h^{L) > 3, 
then, by stability, dE > 2dL > 2^2 = 18, a contradiction. It follows that E can be 
expressed as a non-trivial extension 

(13) 0^L^5^M-^0, 
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where = 2 and hence dL > di = 6. We therefore require (i^-i < c^Af < 12. Since 

d4 = 12, this imphes s < 5. The values s = 3 and s = 4 give c^m > 9 and dM > H 
respectively and a simple calculation gives 7(-E) > | once more. The only remaining 
possibility is s = 5, in which case we could have 7(-E) = 4 if all the above inequalities 
are equalities. Writing M' = K ^ L*, this is equivalent to ffTTj) . Moreover h^{E) = 7, 
so all the sections of M lift to E; it follows that the class of the extension f[T^ belongs 
to the kernel of the canonical map 

H\M* (g)L)^ Hom(i7°(M), H\L)). 

Thus this map is not injective. Dualising, we see that fll2p is not surjective. 

Conversely, suppose M and M' exist satisfying (ITOl) such that (fT2|) is not surjective. 
Then, if we write L = K^M'*, there exists a non-trivial extension (fT3|) with h^{E) = 7. 
Then 7(-E) = 4 and it is easy to check that E is stable. □ 

It is an interesting question as to whether line bundles M, M' as in Proposition 14.21 
can exist. Note that, when M = M', (fT2l) is equivalent to asserting that the map ijj 
of ([8]) is not surjective. This cannot happen on a general curve of genus 10 by [30| 
Proposition 4.2]. 

5. Curves of odd genus 
Let C be a Petri curve of odd genus g > 3. Note that, for such a curve, di = so 

d,,2)=g-2(^2- ^ + ^ - 1^ = 1. 

There are therefore infinitely many non-isomorphic line bundles L of degree di with 
h%L) = 2. 

For g = 3, we have di = 3, d^ = 7, so we are in case (a) of Remark 12.71 and 

• B{2, rf, 4) ^ if and only iid>6. 

• 5(2, 4) ^ if and only iid>7. 

For g = 5,7 and 9, we are in case (b) with d^ = g + 3 = 2di. 
Proposition 5.1. Let C be a Petri curve of genus g = 5,7 or 9. Then 

(i) B{2, c/, 4) ^ if and only ifd>g + 3; 

(ii) B{2,d,A)^%ifd>g + A; 

(iii) if g = 5, B{2,d,'i) ^ ^ if and only if d > 8; moreover, if E E 5(2,8,4), then 
deiE^K and dim 5(2, 8, 4) = 2. 

Proof, (i) and (ii). Since d/^ = 2di and there are infinitely many non-isomorphic line 
bundles L of degree di with h^{L) = 2, it follows from Propositions 12.11 and 12.41 that 
(i) and (ii) hold. 

(iii) Suppose now g = 5 and E G 5(2,8,4); then by Lemma [3.11 h^{detE) = 5. It 
follows at once that det5 = K. The other parts of (iii) now follow from [1]. □ 
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Remark 5.2. For g = 5, the strictly semistable locus -6(2, 8, 4)\i?(2, 8, 4) is isomorphic 
to 5*^5(1,4,2) and therefore has dimension 2. Thus 5(2,8,4) has two components, 
each of dimension 2, which intersect in a subvariety of dimension 1 (the points of this 
subvariety are given by bundles of the form L © {K ® L*) with L G -8(1, 4, 2)). On the 
other hand, /3(2,8,4) = 1. 

Remark 5.3. For g = 7 and g = 9, the argument from [4j does not apply. For any 
M e B{l,g + 3, 5), we have h^^M"^) = g + 7. For 51 = 7, it follows that the map ip of §i) 
cannot be injective, so 4>ai{C) is contained in a quadric. However, since /3(1, 10, 5) = 2, 
it is possible that, for all M G B{1, 10, 5), M = L O L' for some L, L' e B{1, 5, 2) and 
the method of Theorem 13.21 may yield only strictly semistable bundles. For = 9, we 
have /3(1, 12, 5) = 4, so there exist M G -6(1, 12, 5) which are not of the form L ® L\ 
However, we now have h^{M'^) = 16, so (j)M{C) may not be contained in a quadric 
and again the argument of Theorem 13.21 and Remark 13.31 may not yield any bundles in 
5(2,12,4). 

Remark 5.4. \i g > 11, we are in case (c) and ^4 < 2di. It follows that any E G 
5(2,^4,4) has 7(5) < Cliff (C). Moreover, by [HI Theorem 5.2], 7(5) = aiff2(C). 
In particular, in genus 11, we have di = 7 and ^4 = 13. According to Theorem 13. 2^ 
5(2, 13,4) 7^ if and only if there is a non-degenerate morphism C — t- of degree 
13 whose image is contained in a quadric. It is an interesting question to determine 
whether this is true for all Petri curves of genus 11, for some but not all Petri curves 
or never (for further developments, see section [7]). 

6. COHERENT SYSTEMS 

We recall that a coherent system of type (n, d, k) on C is a pair (5, V), where 5 is a 
vector bundle of rank n and degree d and \^ is a fc-dimensional subspace of H^{E). For 
any real number a > 0, the coherent system is a-stable if, for every proper subsystem 
(-F, W), with F of rank r, 

dp dimiy d k 
h a < — h a—. 

r r n n 

There exists a coarse moduli space G{a] n, d, k) for the a-stable coherent systems of 
type (n, d, k) (see [S] for a discussion of the general theory of coherent systems on 
curves) . 

A possible way of constructing bundles in 5(2, d, 4) is to construct coherent systems 
of type (2,(i, 4) and then use the methods of [5j to show that the underlying bundles 
are stable. It turns out that this doesn't help with the problem considered earlier, but 
one still obtains interesting results by interpreting the problem in terms of coherent 
systems. 

We start by recalling a definition from [6]: 

U{n, d, k) := {(5, V)\{E, V) G G{a\ n, d, k) for all a > and E is stable}. 

Proposition 6.1. Suppose d < 2di + l and (5, V) is a coherent system of type (2, d, 4). 
The following are equivalent: 

(i) (5, V) G G{a; 2, d, 4) for some a > 0; 
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(ii) E is stable; 

(iii) {E,V)eU{2,d,4). 

Proof, (i)^(ii). If {E, V) is a-stable and L is a subbundle with cIl > f , then cIe/l < di, 
so h^{E/L) < 2 and hence dim(i7°(L) nV) > 2. This contradicts the a-stabihty of 
{E, V), proving that E is stable. 

(ii) =^(iii). Every line subbundle L of E has degree < di and hence h^{L) < 2. It 
follows that {E, V) is a-stable for all a > 0. 

(iii) ^(i) is obvious. □ 

Remark 6.2. One can show easily that, under the hypotheses of Proposition 16. 11 there 
are no actual critical values in the sense of O Definition 2.4]. 

Remark 6.3. On a general curve of genus g > 3, or more generally whenever di 
computes Cliff (C), Proposition 16.11 is proved for d < 2di in [51 Theorem 1.1]. 

To handle coherent systems whose degree is greater than 2di + l, the following lemma 
will be useful. 

Lemma 6.4. Let {Li,Vi), (L2, V2) be coherent systems of type (1,^^,2) and 

— y Li®L2 — > E — VT — ^0 
an extension with r a torsion sheaf and E a stable bundle. Then 

{E,Vr®V2)eU{2,dEA). 

Proof. Suppose (F, W) is a coherent subsystem of {E, Vi © V2) with F of rank 1. Then 
W C 1/1 © V2, so (F n (Li © L2), W) is a coherent subsystem of (Li © L2, VI © 1^2); it 
follows that dim W <2. On the other hand, by stabihty oi E, dp < '&o {E, Vi © ^2) 
is a-stable for all a > 0. □ 

Remark 6.5. The stable bundles E constructed in the proof of Proposition I2.1( ii) 
all satisfy the conditions of Lemma 16.41 and therefore give rise to coherent systems 

{E, V)eU{2,dEA)- 

We can now interpret our results in terms of coherent systems, beginning with the 
case g = 2. 

Theorem 6.6. Let C be a curve of genus 2. Then 

(i) ifd<5, then G{a; 2, d, 4) = for all a > 0; 

(ii) ifd>6, then U{2,d,A) ^ 0. 

Proof, (i) follows at once from Propositions 12.31 and 16.11 

(ii) For d > 7, this follows from Proposition I2.1( ii) and Remark 16.51 For d = 6, 
{E, V) can be constructed from the sequence (jl]) with E stable. Any line subbundle 
L' of E has degree di' < 2 and therefore /i°(L') < 2; hence {E, V) G f/(2, 6, 4). □ 

Remark 6.7. For d < 3 and d > 6, this is proved in [6j; for d = 4 and d = 5, the 
result in |6j is slightly weaker than ours. 
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Theorem 6.8. For any curve C, 

(i) U{2,dA) ^^ifd> 2rfi + 3; 

(ii) if there exist two non-is amorphic line bundles Li, L2 of degree di with h^{Li) = 
2, then U{2, 4) ^ for d>2di + l; 

(iii) z/ e < 2di and B{2, e, 4) ^ 0, then U{2, rf, 4) 7^ for d > e; 

(iv) if d < min{2(ii, d^}, then G{a; 2, 4) = for all a > 0. 

Proof, (i) and (ii) follow from Proposition I2.1( ii) and Remark 16.51 

(iii) We need only prove that [/(2,e,4) and U{2,e + 1,4) are non-empty, since the 
results for d > e + 2 can then be obtained by tensoring by effective line bundles. For 
these cases, non-emptiness follows from Propositions I2.1( iv) and 16. 1[ 

(iv) follows from Propositions I2.4( iii) and 16.11 □ 

Remark 6.9. Theorem I6.8( ii) was proved for a general curve by Teixidor using de- 
generation methods [29] . 

Theorem 6.10. Suppose d^ < 2di. Then 

(i) if G{a;2,d4,A) 7^ for some a > 0, there exists a line bundle M G 5(1,^4,5) 
such that (f)M{C) is contained in a quadric; 

(ii) if di < 2di and there exists M G B{l,d4,5) such that (f)M{C) is contained in a 
quadric, then f/(2,(i4,4) 7^ 0. 

Proof. This follows at once from Theorem 13.21 and Proposition 16.11 □ 
Theorem 6.11. Let C be a general curve of genus 10. Then 

(i) U{2,d,A) ^^ifd> 13; 

(ii) G(a; 2, 12, 4) = for alla>0. 

However 

(iii) there exist Petri curves of genus 10 for which U{2, 12,4) 7^ 0. 

Proof, (i) is a special case of Theorem I6.8( ii). 

(ii) and (iii) follow from Theorem 14.11 and Proposition 16.11 □ 

7. Postscript 

In this postscript, added in March 2011, we comment on some remarkable develop- 
ments which have taken place since the body of the paper was completed in August 
2010. 

These developments concern the construction of bundles providing counter-examples 
to Mercat's conjecture and relating them to Koszul cohomology, the maximal rank 
conjecture and the geometry of the moduli space of curves [HI [181 [191 [12] . particular 
many examples of bundles of rank 2 have been constructed which contradict Mercat's 
conjecture, all of which involve the non-injectivity of the map ip of All the curves 
involved lie on K3 surfaces and it remains possible that Cliff 2(C) = Cliff (C) for the 
general curve of any genus. In particular, for a general curve of genus g = 11, it 
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is proved in [121 Theorem 5.1] that Chff2(C) = Chff(C); on the other hand, there 
exist curves of genus 11 for which Chff(C) takes its maximal value 5 with Cliff2(C) < 
Cliff(C) [llj Theorem 1.4]. This does not completely answer the question raised in 
Remark 15.41 since we do not know whether any of the latter curves can be Petri. 

For a general curve of any odd genus, it is proved in [Til Theorem 1.1] that B{2, g + 
3,4) is non-empty. Thus the result described in Remark 12.21 can be improved to state 
that, for a general curve of any genus, B{2, g + 3, 4) ^ if d > g + 3. Note here that 
the condition d > g + 3 is equivalent to (3{2, d, 4) > 0. For g = 7 and g = 9, we have 
di = g + 3, so in these cases 

5(2, rf, 4) ^(J}^d>g + 3, 

improving the result of Proposition 15.11 In fact, [TTl Theorem 1.3] allows us to go 
further. Again, for a general curve of any odd genus, the locus in -8(1, g+3, 5) consisting 
of those M for which is not injective has a component of dimension 2 whose general 
point M is not of the form LoL' with L, V e S(l, di, 2) (note that di = ^). By the 
last paragraph of Remark 13.41 this gives a component of dimension 2 of B{2, g + 3, 4). 
This resolves the issues raised in Remark 15. 3[ 

In the case g = 7, a stronger result can be proved very simply for any Petri curve, 
using the fact that all classical Brill-Noether loci of positive dimension are irreducible. 
Consider the irreducible variety V = B[l, 5, 2) x -8(1, 5, 2) of dimension 2. Note that, 
if iL,L) e V, then h°{L (g) L) = A (see [HI Lemma 2.10] for a proof). It follows by 
semicontinuity that h^{L L') < 4 (hence = 4 by the base-point free pencil trick) for 
the general point {L,L') of V. Since -8(1, 10,5) also has dimension 2, it follows that 
the general M G B{1, 10, 5) is not of the form L (g) L' for (L, L') e B{1, 5, 2). It follows 
then from Remarks 13.41 and 15.31 and the irreducibility of -8(1, 10,5) that -8(2, 10,4) is 
irreducible of dimension 2. 

Finally, we are grateful to Gavril Farkas for demonstrating to us that the answer to 
the question raised at the end of section|l]is the expected one, namely that on a general 
curve C of genus 10, there do not exist line bundles M, M' G -8(1, 12, 5) such that the 
multiplication map (12) is not surjective. This implies, by Proposition 14.21 that there 
are no stable bundles on C computing Cliff2(C). The proof runs as follows. Let 
A4 denote the moduli space of curves of genus 10 and let QIq g be the Hurwitz scheme 
parameterising pairs (C, L), where C is a curve of genus 10 and L G -8(1, 6, 2). The fibre 
product X := QIqq y<MGiQ q then parameterises triples (C, L, L') with L, L' G -8(1, 6, 2) 
or equivalently, by duality, triples {C,M,M') with M,M' G -8(1,12,5). The scheme 
X\A, where A denotes the diagonal, parametrises morphisms C — )■ xP^ of bidegree 
(6, 6) which are birational onto their image. It follows that X \ A is irreducible. Now 
suppose that f|T2l) fails to be surjective for some M ^ M' on every curve C of genus 
10. Then, since X \ A is irreducible and the generic fibre of X — )■ is finite, f|T2|) 
fails to be surjective for every pair M ^ M'; hence ([8|) fails to be surjective for some 
M on any curve in the branch locus of QIqq- This branch locus coincides with the 
Gieseker- Petri locus GP^qq, which is known to be a divisor in Ai, while the locus of 
curves which admit a line bundle M with ([8|) not surjective is also a divisor, which 
coincides with the irreducible divisor JCio of curves which lie on K3 surfaces. So we 
have GPiQ g C /Cio and these two divisors must coincide set-theoretically. This is a 
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contradiction since the slopes of these divisors are known (see [9] for GP^q g (where it 
is denoted by E^) and [13] for /Cio) and are different (in fact /Cio is the unique divisor 
in Ai having slope contradicting the slope conjecture of Harris and Morrison). This 
completes the proof and demonstrates again the close connection between higher rank 
Brill-Noether theory and the geometry of the moduli space of curves. 
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